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ABSTRACT 


Transformations  of  the  classical  hypothesis  testing  problem  with 
continuous-lime  observations  to  a  hypothesis  testing  problem  with  counting 
point  process  observations  are  considered.  A  general  form  for  the  random 
intensity  rate  (RIR)  which  can  accommodate  feedback  is  investigated  and  the 
optimal  solution  in  the  Neyman-Pearson  sense  is  specified.  An  analysis  of  the 
performance  of  the  corresponding  optimum  processor  is  studied. 


1.  Introduction 

In  HI  and  (21  we  considered  the  classical  hypothesis  testing  problem 

//o'  under  Pq,  (X,),  0<r<  T,  is  a  'Wiener  process, 

Hi',  under  Pj,  (Af,-J*Sudu),  0<r<  r,  is  a  Wiener  process, 

0 

where  A'-(A",,/',®/'o),  0<r<  T,  are  the  continuous-time  observations,  and  investigated 
transformations  of  this  test  into  the  hypothesis  testing  problem 

Hq.  under  Pq,  (A’,),  0<  r$  T,  is  a  DSPP  with  RIR  (x,'®'),  0<  r ^  T, 

//,;  underP,,  (A,),0^f<r,  isaDSPPwithRlR  (x‘'’),0^r<r,  i 


where  ),  0<r<  P,  are  the  counting  point  process  observations.  In  addition, 

several  suboptimum  detection  schemes  were  presented. 

The  aim  of  the  investigations  in  HI  and  l2l  was  to  find,  from  among  a  given  class  of 
codes,  the  RIR  X  as  a  functional  of  the  “information  bearing  process"  X  and  the  observations 
A,  i.e., 

X,-X,a,A).  (3) 


such  that  we  attain  or  come  close  to  some  “optimum  properties". 

In  this  paper  we  extend  the  results  of  H)  and  |2]  by  finding,  from  the  class  of  o- 
admissible  codes,  the  Neyman-Pearson  optimum  RIR  X.  The  paper  is  organized  as  follows.  In 
section  11  we  consider  the  classical  “input”  hypothesis  testing  problem  of  deciding  between  two 
absolutely  continuous  measures  Pq  and  Pj  (P,«Po),  given  some  observation  process 
X-(X,,F,9F(,),  T.  In  the  sequel  the  corresponding  Radon-Nikodym  derivative,  denoted 
by  A  7,  will  be  called  the  input  likelihood  ratio.  We  also  consider  the  “output"  hypothesis  test¬ 
ing  problem  of  deciding  between  the  probability  measures  Po  and  .P,  given  the  counting  point 
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process  observations  0<f<  T.  The  corresponding  Radon-Nikodym  derivative 

will  be  called  the  output  likelihood  ratio.  Theorem  1  specifies  the  Neyman-Pearson  optimum 
RIR  (of  significance  level  ao)  for  detection  in  the  class  of  o-admissible  codes.  It  is  shown  that, 
if  the  causality  condition  on  X  is  dropped,  the  optimal  RIR  is  given  by 

“  Mo  +  f>  Xlo.ii(Ar),  (4) 

for  all  r,  0<r<  T,  where  b  is  constant  and  xio.iL)  is  the  characteristic  function  of  the  set  [0,Z.l. 
We  conjecture  that  if  X  is  nonanticipative  the  RIR  is  given  by  (for  more  details  see  section  II) 

A,  -  Mo+ ^>  Xlo.i,)(A,),  (5) 


for  all  /,  0<  T. 

The  degradation  which  appears  in  the  output  detection  problem  by  using  the  optimum 
RIR  X  (introduced  by  the  counting  point  process  observations)  is  established  in  section  III. 
The  main  result  in  section  Ill  is  presented  in  Theorem  2.  It  relates  (see  also  Lemma  3)  the 
power  and  the  probability  of  false  alarm  of  a  very  general  hypothesis  testing  problem  when  its 
sample  space  is  not  directly  observable  (DSPP  observations)  to  the  same  parameters  a  and  /3 
one  would  obtain  if  the  input  space  were  directly  observable. 

II.  The  Optimal  Random  Intensity  Rate  for  Detection 


Let  us  consider  the  "input”  hypojthesis  testing  problem  of  deciding  between  two  absolutely 
continuous  probability  measures  Pq  and  P\  (P^«Pq),  defined  on  the  measurable  space 
(fl,P),  given  the_observatjpn  process  A'-(A,,P,®PoK  T.  The  construction  of  the  proba¬ 
bility  measures  Pq  and  P|  is  given  in  I3l.  The  corresponding  Neyman-Pearson  test  of 
significance  level  ao  is  completely  characterized  by  the  sufficient  statistic  (A  r),  where  L  is 
the  associated  threshold  (4). 

Let  us  consider  the  “output”  hypothesis  testing  problem  of  deciding  between  the  probability 
measures  Pq  and  Pi  given  the  observation  counting  point  process  N- (A’,,Po®P,),  0$  r $  T. 
The  corresponding  Neyman-Person  test  of  significance  level  oq  is  completely  characterized  by 
X(o£i(Ar)  where  L  is  the  threshold  . 

Definition  1.  The  class  of  codes  satisfying  the  peak  and  average  power  constraint 

0^X,(A',NXc  and  Xjds  <  qc,  (6) 


for  all  r  and  t,  0< r<  r  and /— 0,1  and  constants  r  and  4,  c€P4  and  0<9<1  is  called  0- 
admissible. 

Definition  2.  The  coding  X“(X,(A’,N),P,®P,),  T,  is  said  to  be  optimum  in  the  Seyman- 

Pearson  sense  of  significance  level  ao  if  over  the  class  of  o-admissible  codes  the  supremum 

SUPr  (7) 

'  u 


is  achieved  for  all  a,  a  <  oq,  i  e.,  the  coding  X  maximizes  the  power  among  all  Neyman 
Pearson  tests. 


Remark.  The  optimal  RIR  X  in  the  Neyman-Pearson  sense  features  the  best  performance  for  ^ 
only  a  given  probability  of  false  alarm  oq.  Therefore  the  above  optimality  criterion  leads  in 
general  to  solutions  which  are  "locally”  optimal.  In  other  words  for  each  ao  a  different  code  X  /  Codes 
might  be  obtained.  .nd/or 

Dial  I  Special 


Due  to  analytical  difficulties  we  will  restrict  the  following  analysis  to  the  ease  where  X,  is 
measurable  with  respect  to  the  <r -algebra  Fj-^F,  for  all  (,  T. 

Theorem  1.  The  RIR  X-(X,,Fr®^;K  0^  T,  corresponding  to  the  (output  observation)  count¬ 
ing  point  process  N  is  optimum  in  the  Neyman-Pearson  sense  (f  it  is  given  by 

k,(X,N)  “  hq  +  b  x\o.L]^T^^ 

where  A— (1A-— — )c,  for  all  t,  O^tK  T. 

PVOIQ 

A  proof  of  this  theorem  appears  in  (31. 

Remark.  The  above  theorem  implies  that,  under  the  Neyman-Pearson  optimality  criterion, 
feedback  does  not  increase  the  power  of  the  output  hypothesis  testing  problem.  This  result  is 
somewhat  similar  to  the  result  obtained  on  the  capacity  of  the  Poisson  type  channel  under  a 
peak  and  average  power  constraint  (see  also  (5)- 17]). 

Since 


1— a 


1  + 

1— /S 

for  all  s,  T,  we  conclude  that  the  test  statistic  for  the  output  hypothesis  testing  problem 

is  given  by 


<  £  -  Ho 


where 


1—^  fio+b 


1— a  M0+® 


l—p  liQi+b 


1  + 

i—a  Mo’^b 


For  the  case  where  X,  is  measurable  with  respect  to  the  cr-algebra  F,9F,,  for  all 
t,  0^  f  <  r,  we  state  the  following 
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Conjecture  1.  The  RIR  X— T,  corresponding  to  the  (output  observation)  count¬ 
ing  point  process  N  is  optimum  in  the  Neyman-Pearson  sense  if  it  is  given  by 

X,(Jf,N)  “  fio  +  (13) 

where  i)-  (lA  — ® —  )c,for  all  t,Q^t^T.  The  threshold  L\R^-'  R^  is  defined  by^ 
pVao 

Pq{A,  ^  L,  )  »  ttf). 

Remark.  The  RIR  X  described  by  (13)  can  be  seen  as  the  causal  version  of  the  RIR  X  given 
by  (8). 

In  the  next  section  an  analysis  of  the  performance  of  the  optimum  detection  scheme  is 
presented.  It  is  shown  that  an  equivalent  form  of  (12)  can  be  given  that  allows  a  simple 
analysis  of  the  performance  of  the  above  optimum  detection  scheme. 


III.  Performance  Analysis  of  the  Optimal  Detection  Scheme 


The  performance  analysis  of  the  optimum  Neyman-Pearson  detector  (12)  is  greatly  simplified 
by  the  following: 

Lemma  1.  If  ft a  and  Xj  -  fio+b-xiAr)  for  every  s,  T,  then 

A  f  “  A  7 {Sf)y  (14) 

where  Ar  is  a  nonincreasing  Borel  function  of  Nj. 

A  proof  of  this  lemma  based  on  the  abstract  Bayes  formula  (8)  is  given  in  (3). 

Since  -  A 7(^7)  is  a  nonincreasing  function,  the  Neyman-Pearson  test 


Ar 


>  L 

<  L 


Wo. 


(15) 


(where  L  is  the  threshold  of  the  output  test)  is  equivalent  to 


W7 


W, 

Wo 


(16) 


(where  I  is  the  corresponding  new  threshold  of  the  output  test). 

Since  A  7  is  a  nonincreasing  function  of  the  observations,  the  power  B  the  level  a  of 
the  output  hypothesis  testing  problem  with  counting  point  process  observations  can  be  reduced 
to 


B~P,(Nr  <  /)-  1^,(W7-*). 

a~Po(Nr  <  /)-  'iPo^Nr^k), 
«>o 


(17) 


*  Randomized  tests  are  not  considered  here.  The  extension  to  randomized  tests  can  be  done  in  the  usual 
manner  |4l. 


where  1  is  the  new  threshold. 

In  the  following,  with  straightforward  mathematics,  we  will  find  an  equivalent  expressions 
for  p  and  a.  Our  standing  assumption  is  that  the  observation  process  N-(Ni,F(^F,),  0$  T, 
is  a  doubly  stochastic  Poisson  process  (DSPP). 

Let  us  first  relate  the  power  and  the  probability  of  false  alarm  o  of  the  input  to  the 
power  /§  and  probability  of  false  alarm  a  of  the  output.  We  can  give  the  following 

Lemma  2. 


£ - - exp[-(^o+*)7'J  -  X 

A-0  ^  •  A-0  ^  * 


t-o 


/-I 


(18) 


k\ 


exp[-(/xo+b)7'l  -  ^  —l(^o+b)^exp(-bT)  -  fio)exp(-^oF>a. 


k-O 


Proof.  Both  and  a  can  be  obtained  with  some  easy  manipulations,  and  only  those  for  ^  are 
presented. 

h  -  XP^ST~k)~  l4T^il(Mo+Axio.ii(Z))*expl-(Mo+*Xio.il(2))7"n 

*-0  *-0  ■ 


-  X  b)*exp(-(Mo+*)7'l  -  Moexp(-#io7')l(l  - /3)1 

*-o  *  • 


/-I  [(itn+b)]*  r* 

“  X - V\ - expl-fMo+^Jn  -  -T7((M0+f>)‘exp(-i>r)  -  ^o*lexp(-Mo7')/3.  □ 

*-o  *-o^- 

Let  us  compare  the  pairs  (/3,a)  and  in  the  limiting  case  statistic  can  be 

easily  reduced  to 


j  -0  -  W, 

\  H, 

The  power  and  the  probability  of  false  alarm  a  can  also  be  computed  directly: 

p  -  ?,(Nr-0)  -  e-‘’^  +  (1  - 
5  -  Po(A'r-O)  -  +  (1  -  e-^^a. 

Fig.  1  illustrates  graphically  the  results  that  we  might  expect  in  terms  of  the  receiver  operating 
characteristic  (ROC).  Since  ^-4  implies  /3«1,  the  only  point  of  intersection  of  the  above 
curves  occurs  for  (a,/3)-(l,I). 

Another  useful  representation  for  a  and  p  is  given  in 
Lemma  3. 

^  1  “  ^1  )(IO./.l(2)' 

(ix  F)^  ^  T*^  (21) 

^  -  1  -  £||^  — — exp(-/ior)  -  X  ^l<Mo+*)‘cxp(-br)  -  fi^hxp{-fi.oT)  x\o.L\^Z)] 


'  By  abuse  of  notation. 
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Fig.  1  The  receiver  operating  characteristic  (optimum  processor). 

a  -  1  -  £o  xio,/.|(.Z), 

(ii  7* )  ^  I  (22) 

a  -  1  -  £o(£ — — exp(-Mo7')  -  ^  l(Mo+*)*exp(-i)r)  -  #ioMexp(-Mo7')  xio.i)<Z)l, 

k>l  *-0  "  • 

k^here  ^(o.il^^)  denotes  the  characteristic  function  of  the  set  lO,£l  on  the  real  line. 

Proof.  The  proof  can  be  easily  supplied.  □ 

If  we  define  the  function  Kop,;/(+— '10,1]  by 

Xop/^0  -  X  -TTMoexpf-MoT) 

-  X  ■7T^^o+*^*expl-(^o+*)2'l  -  Moexp(-Mo2'))  xiot)(C).  (23) 

*-o  ■ 

for  all  {,  {€/?+,  we  arrive  at  the  following  fundamental  result: 

Theorem  2.  The  optimum  detector  at  the  output  of  the  processor*  performs  a  randomized  test  given 

by 

»Cop,({),  (24) 

which  is  an  approximation  to  the  optimum  input  test  specified  by 

^lo./,i({K  (25) 

for  all  £,  {€/?+,  respectively.  The  limiting  case  where  mo”0  can  easily  be  analyzed.  We  have 

P~\-Eaio.L]^Zn\  -  e~0‘h 
d  -  I- £oX(o.ii(^)(l 

'  See  111-131  for  the  definition  of  the  processor. 


(26) 
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Fig.  2  Representation  of  the  optimum  input  and  optimum  output  test. 

and  thus  the  test  statistic  is  given  by 

Kopi^O  -  n  -  e~‘’^)xiou)^P'  ^27) 

for  all  {,  {€/?+.  The  results  obtained  are  depicted  in  Fig.2. 

The  decision  procedure  at  the  output  of  the  processor  is  strictly  suboptimal  when  com¬ 
pared  to  the  optimal  decision  procedure  at  the  input,  should  the  input  be  completely  observ¬ 
able.  This  is  true  since,  under  the  Neyman-Pearson  criterion,  any  randomized  test  will  not  per¬ 
form  as  well  as  the  corresponding  optimum  test  given  by  (25)  [9,  p.65l.  This  agrees  with  our 
intuitive  feeling  that  the  transformation  which  takes  place  through  the  processor  (see  also 
Fig.2.1  in  (31)  affects  the  information. 

Remark.  The  randomized  test  has  a  very  simple  probabilistic  interpretation.  According  to 
this  interpretation,  for  a  particular  value  of  the  input  likelihood  ratio  f,  with  probability  »c„p,  (f) 
we  decide  that  the  null-hypothesis  is  true  and  with  probability  1  -  ({)  we  decide  that  the 

alternative  is  true.  The  deviation  between  the  optimum  randomized  test  ^lo/,)  and  the  ran¬ 
domized  test  will  define  a  measure  for  evaluating  the  performance  of  the  processor. 

IV.  Conclusion 


In  this  paper  the  Neyman-Pearson  optimum  RIR  A  from  among  the  class  of  o-admissible  codes 
has  been  specified.  Since  the  problem  of  finding  the  ROC  even  for  simple  hypothesis  testing 
problems  is  known  to  be  analytically  intractable,  a  new  type  of  comparison  between  the 
optimum  and  a  suboptimum  processor  has  been  introduced.  In  particular,  the  output  Neyman- 
Pearson  test  compared  to  the  similar  test  for  the  input  turns  out  to  be  a  randomized  test.  The 
latter  test  shows  us  to  what  degree  the  processor  specified  by  the  RIR  A  leads  to  a  loss  of 
"information”.  This  loss  supports  our  intuitive  feeling  that  the  "stochastic  mapping"  describ¬ 
ing  the  processor  has  to  reduce  the  amount  of  "information”  available  at  its  input. 
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